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Abstract. 

Random walks of particles on a lattice are a classical paradigm for the microscopic mechanism 
underlying diffusive processes. In deterministic walks, the role of space and time can be reversed, 
and the microscopic dynamics can produce quite different types of behavior such as directed 
propagation and organization, which appears to be generic behaviors encountered in an important 
class of systems. The various aspects of classical and not so classical walks on latices are reviewed 
with emphasis on the physical phenomena that can be treated through a lattice dynamics approach. 

TEMPORAL VERSUS SPATIAL DISPERSION 

One of the fundamental physical paradigms, applicable to a wide variety of physical 
processes, is that of spatial dijfusion. The text-book example is a random walker on 
a one-dimensional lattice (see, e.g. f^) where at each tick of the clock, the walker 
takes a step either to the left or to the right, the direction being chosen randomly with 
equal probabilities. One then asks what is the probability that the walker be at a given 
position after a given time. If the walker starts at a known point, the answer is a binomial 
distribution which, in the continuum limit, becomes a Gaussian. The variance of the 
Gaussian grows with time so that the localization of the walker decreases, and we say 
that the walker disperses. If the probability for the walker to step in one direction is 
greater than that for the opposite direction, then the walker propagates in the direction 
of higher probability and will eventually visit each site of the lattice in that direction. The 
typical spatial diffusive behavior is then manifested in the continuum limit as a Gaussian 
about a most-likely position which moves at a constant velocity. However, there are a 
number of situations in which, instead of asking where the walker would be after a given 
time (long with respect to the duration of an elementary time step), it is more natural to 
ask how long it will take to reach a given point, at some large distance from the starting 
position (large compared to the unit length covered during the elementary time step). 
More precisely for a stochastic process, one then asks what is the distribution of times 
taken to reach that point, a question related to the problem of first-passage processes [2]. 

Everyday examples involve processes in which the goal is to arrive at a given point: for 
example, the marathon (wherein we ask for the distribution of finishing times), certain 
financial instruments, such as stock options (wherein we ask for the distributions of 
times needed for an asset to reach a certain value), traffic-flow (wherein we ask for 
the distribution of arrival times at destination), and packet transport over the internet. 
A more technical example is the behavior of certain cellular automata which model 
the motion of a particle on a substrate of scatterers (in 1 or 2 dimensions) where, for 



certain types of scatterers, the particle ends up propagating along a particular channel, 
and, again, the first-passage time is the physical quantity of interest. A paradigm for this 
type of behavior is the automaton known as "Langton's ant" |0, 0] which is described 
below. The interesting fact is that even a simplified one-dimensional version of that 
automaton shows the same type of behavior. This 1-D model is the analogue of the one- 
dimensional random walker, with the important difference that the roles of space and 
time are reversed: for large distances, the distribution of first-passage times is Gaussian 
in the time variable with a variance that grows with increasing distance from the origin. 
In analogy with spatial diffusion that occurs in ordinary diffusive phenomena, this 
generic behavior is called temporal dijfusion. We will show how starting form a simple 
model, a gQWQXdX first-visit equation is obtained which in the hydrodynamic limit yields 
the propagation-dispersion equation (PDE), the analogue of the classical advection- 
diffusion equation, and how this PDE further generalizes propagation and dispersion 
processes. 



FIRST VISIT EQUATION 

The automaton known as "Langton's ant" [3] lives in a two-dimensional universe 
spanned by the square lattice with checker board parity, so defining H sites and V sites. 
A particle (the ant) moves from site to site (by one lattice unit length) in the direction 
given by an indicator. One may think of the indicator as a 'spin' (up or down) defining 
the state of the site. When the particle arrives at a site with spin up (down), it is scattered 
to the right (left) making an angle of -\-k/2 {—k/2) with respect to its incoming velocity 
vector. But the particle modifies the state of the visited site (spin up <^=^ spin down) so 
that on its next visit, the particle is deflected in the direction opposite to the scattering 
direction of its former visit. Thus the particle entering from below a H site with spin 
up is scattered East, and on its next visit to that same site (now with spin down), if it 
arrives from above, it will be scattered East again, while if it arrives from below, it will 
be scattered West. Similar reasoning shows how the particle is scattered North or South 
on V sites. 

At the initial time, all sites are in the same state (all spins up or down), and the 
position and velocity direction of the particle are fixed, but arbitrary. So if we paint 
the sites black or white according to their spin state and we start with say an all white 
universe, then, as the particle moves, the visited sites turn alternately black and white 
depending on whether they are visited an odd or even number of times. This color coding 
offers a way to observe the evolution of the automaton universe. The particle starts 
exploring the universe by first creating centrally symmetric transient patterns (see figures 
in references [3]), then after about 10 000 time steps (9977 to be precise), it leaves a 
seemingly 'random territory' to enter a 'highway' (see Fig. 1 ) showing a periodic pattern. 
The "disordered" phase is not what a random walk would produce: the automaton is 
deterministic and its rules create correlations between successive states of the substrate, 
so also between successive positions of the particle. The power spectrum computed from 
the particle position time correlation function measured over the first 9977 time steps 
goes like ~ v^^ with ^ ~ 4/3. In the ordered phase (the 'highway'), the power spectrum 
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FIGURE 1. Langton's ant trajectory after 12,000 automaton time steps. The upper box is a blow-up of 
the highway showing the periodic pattern. Sites with open squares and dark squares have opposite spin 
states (up and down). 



shows a peak at v = 1/ 104 with harmonics. Indeed in the highway, the particle travels 
with constant propagation speed: c = 2-\/2/ 104 (in lattice units). 

Because of the complexity of the dynamics on the square lattice, Grosfils, Boon, 
Cohen, and Bunimovich |0] developed a one-dimensional version of the automaton 
for which they provided a complete mathematical analysis also applicable to the two- 
dimensional triangular lattice. In the one-dimensional case, the particle moves in the 
direction of its velocity vector with probability q and in the opposite direction with 
probability (1 — ^), the direction being dictated by the "spin" of the lattice site, which 



is then reversed after the passage of the particle. The mean-field equation describing 
the microscopic dynamics of the particle with the general condition that the spins at the 
initial time are randomly distributed on the lattice, reads [5] 

1,^ + 1) = qf{r,t) + {\ - q) f{r,t -2) . (1) 

Here /(r, t) is the single particle distribution function, i.e. the probability that the particle 
visits site r for the first time at time t, and q is the probability that the immediately 
previously visited site along the propagation strip (the highway) has initially spin up, 
i.e. the probability that the particle be scattered along the direction of its velocity 
vector when arriving at the scattering site at r — 1. ^ An important result follows that 
can be formulated as a theorem [5] : a particle moving from site to site in a one- 
dimensional lattice fully occupied with flipping scatterers (spins), propagates in one 
direction, independently of the initial distribution of the spins on the lattice. 
There are two points of particular interest here. 

(i) First one notices that Eg. (H]) has the same structure as the equation for the one- 
dimensional random walk ^ 

g{r+\,t+\) = qg{r,t) + {\ - q) g{r + 2,t) , (2) 

except that the in the second term on the r.h.s. of Eq. ([T]) one has t — 2 whereas in the 
random walk equation one has r -f 2; this increment transfer between space and time 
makes a crucial difference as we shall see below. 

(ii) Eq.O is a particular case of a general equation To see this, consider a walker on 
a one-dimensional lattice and let fit / 5t\r/5r) be the probability that it takes t /5t time 
steps to reach the lattice position r/ 5r, given that the walker is at the origin at time t = 0. 
Whatever the microscopic dynamics, we assume that we are given, or can work out, the 
set of probabilities {pj{r)}°J^^ that the time between the first visit of the lattice site r/5r 
and the first visit of the next position, r/dr + 1, is iljdt. Conceptually, these represent 
the probabilities of various waiting times from the first visit of lattice site r/ 5r until the 
first visit to r/5r+ 1, i.e. the distribution of single-step waiting times. It is then clear that 
the probability that it takes time t for the walker to reach the lattice site r + 5r is equal 
to the probability that it takes time t to reach lattice site r and that the waiting time is 
zero, plus the probability that it takes time t — dtto reach site r and that the waiting time 
is dt, plus the probability that the waiting time is 25t, ... so that the master equation is 

f{t/dt;r/dr+\)=Y^Pj{r)f{t/dt~^j;r/dr), (3) 

7=0 

or 

f{t-r+dr) = f^pj{r)f{t-Tj;r). (4) 

7=0 



A similar equation holds for the two-dimensional triangular lattice and these equations were shown to 
yield exact solutions for propagative behavior (corresponding to an ordered phase of the lattice) in the 
classes of models considered by Grosfils et al. 



This is the first visit equation [6] where pj is the probability that it takes time Xj = jlj 5t 
for the particle to propagate from r to r + 5r, i.e. Tj is the time delay between two 
successive first visits on the propagation strip for the path with probability pj. The sum 
is over all possible time delays, weighted by the probability pj, and n can be finite |@] or 
infinite [7], the two formulations being equivalent, depending on whether the distribution 
of the delays is contained either in the t/s or in the pfs. 

For one particular realization, the successive time delays are set by a given spatial con- 
figuration of the time delayers, and the time taken by the particle to perform a displace- 
ment from r to r+ dr depends on that configuration. For an ensemble of realizations, 
the distribution function of the time delays defines the average displacement time 

n n 

i^) = E Pj = E l^jPj = (Ai) St , (5) 

7=0 ;=0 

and the variance 

U=o j=o J 

= {{^')-{^f){5t)\ (6) 

where jij = Xj/5t is the number of time steps during the time delay Xj. The general 
condition on the pj distribution is that its moments be finite. For specific lattice dynamics 
(such as for the 1-D model described above) /ij is known analytically and the moments 
can be computed explicitly. For instance, one can then show that the propagation velocity 
of Langton's ant is c = dr/{x) = 2v/2/104 L^. 



PROPAGATION-DISPERSION EQUATION 

The systems that we are discussing exhibit two time scales which correspond to (i) a 
propagation process characterized by the average time necessary to complete a finite 
number of displacements r/5r 

m = {^)rY^. (7) 

and (ii) the dispersion around this average value characterized by the variance 

Var[r,] = ((Ai2)-(M)2)(50'f . (8) 

or 

For finite r, these are finite quantities. Correspondingly we define the following quanti- 
ties that will be used in the hydrodynamic limit of Eq.© 

- = (M)|^, (9) 
c or 



and 

r=((M2)-(^)2)M. (10) 

or 

c (7^ 0) will be identified as the propagation speed and 7 (> 0) will be identified as the 
dispersion coefficient. 

The hydrodynamic limit, i.e. for r/dr^ 1, can be obtained by multi-scale expansion 
starting from Eq.© or by the generating function method (with application of the central 
limit theorem) ^. With the multi-scale expansion, one obtains the propagation-dispersion 
equation ISj] 

drf{r,t) + -drf{rj) = lyd^fM , (11) 
c 2 

and with the other method, one obtains its solution |@] 

= y5M-'exp(-<^ I. (12) 

with the the initial condition that at the origin, say at r = 0, /(O, t) = 5{t). Note that this 
condition is not restrictive in that, if the initial distribution is given by some function 
f{t; r = 0) = fo{t), the solution is the result (fT^ convoluted with fo{t) . 

It is clear from (fTTT) . that c is a propagation speed, and 7 is a transport coefficient 
expressing dispersion in time (instead of space like in the classical Fokker- Planck 
equation for diffusion). Equation (fTTTl is the propagation-dispersion equation governing 
the first-passage distribution function of a propagating particle subject to time delays. 
Figure 2 illustrates these results. 

Note that for the biased random walker in the continuum limit, the exact first passage 
time distribution is known liJii] to be 

fU-r) = — exp ( -i^lllfil! I , (13) 

where D is the spatial diffusion coefficient. The difference between this expression and 
(fT^ is due to the fact that the latter is an approximation which is only valid for large r. In 
this regime, the exact result only gives a non-zero probability for (r — ct) / 2Dt = 
which implies ct = r + {^^j2Dr/c^ = r{\ + i^ (^y^2D/cr^^ . So, for large r we can 
use this approximation to write the exact distribution as 

-3/2 / (r._rt)^ 



^"-■''^ = vm^-'^' I ' 1 v'zD/-) ) , (14) 

which, with D/c^ = 7, agrees with the large-distance result (fT2ll . We emphasize that 
Eq. (fT3b is exact in the continuum limit, i.e. for vanishing 8r and 5t, whereas the only 



The reader is referred to for the analytical computations. 
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FIGURE 2. Probability distribution f{r = 3 x 10^, t) based on general equation ©. (a) time delays 
equally distributed for j =0, 1, •••,9, with = 0.1;c = 0.1 and 7= 33; half-width ^/ZyFci 1.41 x 10^. 
(b) time delays exponentially distributed: pj = Cexp—jij, with y = 0, 1, 9, )3 ~ 0.25, and C = 
[l!j=ojr^ = 1/45; c = 0.128 and 7= 52.7; half-width ^y/2frc^ 1.78 x lOl The numerical simulation 
data and the analytical expression (Ea. illi : solid line, not visible) coincide perfectly. Insets show large 
scale representation. Space and time are in automaton units. 



restrictions on the general result (fT2l) are that r is large and that the first two moments of 
the elementary waiting time distribution, (t) and 7, exist. The latter condition precludes 
the limit of the symmetric random walker, c ^ 0, for which (t) = 5r/c diverges (see Q 
and ©). 



TEMPORAL DIFFUSION 

It follows from Eqs.dH) and dlOb . that the dispersion coefficient 7 is given by 

y^!Sl^ (,5) 
r 

which, for large r, is reminiscent of the classical expression for the diffusion coefficient: 
D — \imt^oo{r^{t)) /2t. Comparison of the two expressions shows interchange of space 
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FIGURE 3. New York marathon (1996): distribution of arrival times (in minutes; N = number of 
runners). Data (black dots) and Gaussian fit (solid curve). The skewness indicates that all runners are 
not subject to the same waiting time probability distribution. 

and time, and measurements of the variance {t^) — (?^)^ should show a linear dependence 
in terms of the distance with a slope equal to y in the same way as the diffusion 
coefficient is obtained as the slope of the mean-square displacement versus time in the 
long-time limit. 

An interesting case is the experimental study of the diffusion of a single particle in a 
3-D random packing of spheres [TT] which describes the motion of a particle through an 
idealized granular medium. Here one measures particulate transport and 'dispersivitv' 
which corresponds precisely to the quantity y. The experimental data presented in lUlll 
show that the mean square transit time of the particle through the medium is a linear 
function of the mean transit time (Figs. 10 and 11 in llllll ) itself a linear function of the 
percolating distance (Fig. 2 in ifTH]). This observation is a clear experimental illustration 
of the feature of Eq. dTSt . This experimental study also shows that the particle transit 
time is Gaussianly distributed in time (see Fig. 9 in luJ]) in accordance with the solution 
(OofEq.dn]) (see Fig.2). 

A popular example where the concept of temporal diffusion is obviously relevant is 
the Marathon. Each runner can be viewed as a particle moving on a one-dimensional 
path - the race track - starting from a given origin and heading towards the finish line, 
with time delays along its trajectory. Each such trajectory represents one realization of 
the dynamics, which generates a distribution approximated by a Gaussian (as shown 
in Fig. 3) whose first moment is the average time of arrival ((t) ~ 255 min) with 
c = 42.195 X 60/ (t) ~ 10 (km/hour), and whose second moment gives a measure of 
the dispersion coefficient 7~ .055 min^/m. 

The dispersion coefficient can be further expressed in terms of the fluctuations in 




the local propagation velocity v(r), a quantity with average value c. In fact it is the 
reciprocal local velocity which is physically relevant: it is the time taken by the particle 
to propagate from position r to r + 5r (divided by 5r). Then indeed 

{tr) = {f dr'^)= f dr'{^) = -, (16) 
Jq v[r') Jo v{r') c 

which is consistent with the definition of the propagation speed. It is then easy to 
compute the variance in terms of the reciprocal velocity fluctuations 5v^^{r) = v^^{r) — 
(v-l)=v-l(r)-c-l, 

{tj)-{tr)^ = f dr' f dr"{8v-\r')8v-\r")). (17) 

If the dynamics of the propagating particle is such that the correlation function on 
the r.h.s. of (fT7b is 5-correlated, i.e. (5v^^(r') 5v^^(/')) = ^q5{^ — ^) with = 

((5v^^)^) = (-j) — \, and where is the elementary correlation length, it follows from 
(fTSb and dni) that 

7=^((v-2)-c-2), (18) 

that is 7 is the covariance of the reciprocal velocity fluctuations multiplied by the corre- 
lation length. This result is analogous to Taylor's formula of hydrodynamic dispersivity 
which is expressed as the product of the covariance of the velocity fluctuations with a 
characteristic correlation time [ 12]. Here 7 is the temporal dispersivity. 

In classical advection-diffusion phenomena, the control parameter is the Peclet num- 
ber P = UL/2D, where U denotes the mean advection speed, L, the characteristic 
macroscopic length, and D, the diffusion coefficient (see e.g. [13]). The analogue for 
propagation-dispersion follows by casting Eq. lfTTT) in non-dimensional form 

2T 

drf{r,t) + dtf{r,t)^B-'d^fM; B^ — . (19) 

yc 

Here r and t are the dimensionless space and time variables: r = r{cT)^^ and t = 
tT^^, where T is a characteristic macroscopic time. B is the control parameter for 
propagation-dispersion: it is a measure of the relative importance of propagation with 

respect to dispersion. Indeed, B = ^ = 4r =Ld/ Lp, i.e. the ratio of the characteristic 
dispersion length Lo to the characteristic propagation length Lp. At high values of B, i.e. 
Ld 3> Lp, the distribution function is very narrow, and transport over large distances 
(r > cT) is dominated by propagation. 



GENERALIZED PROPAGATION-DISPERSION 

There are two important generalizations of the propagation-dispersion equation. The 
first generalization is for temporal diffusive behavior in inhomogeneous systems, i.e. 
for processes where the waiting time probabilities depend on the location of the particle. 



The pfs are then space dependent, and the propagation-dispersion equation becomes ||^ 



with 



1 ^ , , 



and 



where 



and 



rj 8r 

o\r) = {5tf £ 

k=\ 



c{r) dr 



r/ 8r oo 

T{r) = 5tY^Y^jPj{{k-l)dr). 

k=\ j=0 



Y^pj{{k-\)5r)j^-[l^pj{{k-l)dr)i 

j=o \j=o 



(20) 



(21) 



(22) 



(23) 



(24) 



The solution of Eq.d^ reads 




■exp 



l(5\r) 



h{t')dt'., 



(25) 



where /o {t) = f{t;r = 0) . Buminovich and Khlabystova I?!] have studied models similar 
to the one-dimensional model described earlier in this chapter, but in which the scatterers 
only change state after multiple scattering events fT4]. In this case, the distribution of el- 
ementary waiting times becomes dependent on the lattice position, and the propagation 
speed and dispersion coefficient acquire a spatial dependence. Thus, while the distri- 
butions of first passage times are still Gaussian, they are not "diffusive" in the usual 
sense since the inverse propagation speed and dispersion coefficient are not constants 
(Eqs.(ESll21)- 

The phenomena described so far are for cases where the variance of the elementary 
time-delay processes exist. The second generalization is for the interesting class of 
similar, but more complex processes which are described by power-law distributions 
which do not possess second moments, e.g. pj ~ T/^*^^+"^, in which case, for < a < 1, 
the distribution appearing in the central limit theorem is no longer Gaussian (see e.g. lll5l] 
and the appendix in lfl6ll \ 

For the Pareto distribution 



p{t)=&{t-to) 



A+a 



< a < 2, a 7^ 1 



(26) 



one can show that the propagation-dispersion equation becomes 



dr 



fa{t\r/5r) 



ato d - a) 



{\-a)5rdt 



-t, 



5r dt' 



fa{t\r/5r) 



(27) 



where the fractional derivative can be defined through the Fourier transformation 



Mt) 



1 

27tJ- 



d(o{-i(o)^ Qx^{-im)f{(o) 



(28) 



Equation (l27t is the fractional propagation-dispersion equation. For the special case 
a = 1/2, the equation becomes 



to d ^/ttzo (5^/^ 
5rdt 5r dt^/^ 



whose solution reads 



/i/2 {t;r/5r) 



(i) 



3/2 



exp 



fl/2 {t;r/5r) 



4(? + i?o) 



(29) 



(30) 



The fractional equation (ITTl) should be contrasted with the fractional Fokker-Planck 
equation which has been studied extensively for anomalous spatial diffusion ll22ll . The 
fractional propagation-dispersion equation (l27t is new and is expected to be appropriate 
for the description and the analysis of non-Gaussian (anomalous) temporal diffusive 
processes. 



COMMENTS 



There is an algebraic similarity in the structure of the propagation-dispersion equation 
(fTTTl and that of the classical advection-diffusion equation Jll] which can be formally 
transformed into each other by interchanging space and time variables. It should be clear 
that the two equations describe different, but complementary aspects of the dynamics of 
a moving particle. Solving the propagation-dispersion equation answers the question 
of the time of arrival and of the time distribution around the average arrival time in 
a propagation process. It is also legitimate to ask the complementary question "where 
should we expect to find the particle after some given time ?" which should be long 
compared to the elementary time step, but short with respect to the average time of 
arrival. We will then observe spatial dispersion around some average position which 
can be evaluated from the solution of the advection-diffusion equation. This observation 
stresses the complementarity of the two equations. 

Because the propagation-dispersion equation describes the space-time behavior of 
ihe, first passage distribution function f{rj), i.e. the probability that a particle be for 
the first time at some position, it describes transport where a first passage mechanism 
plays an important role. So the equation should be applicable to the class of front-type 



propagation phenomena where any location ahead of the front will necessarily be visited, 
the question being: when will a given point be reached? 

Besides the examples discussed above, temporal diffusion is also encountered in 
shock propagation in homogeneous or inhomogeneous media ifl?!] or packet transport 
in the Internet 118^. As the propagation-dispersion equation is for the first-passage time 
distribution, it should also be suited for the description of transport driven by an input 
current in a disordered random medium [ 19]. In the area of traffic flow, there are typical 
situations where cars moving on a highway from location A to location B, are subject to 
time delays along the way, and - with the assumption that all cars arrive at destination 
- one wants to evaluate the time of arrival [£0]. Financial series as in the time evolution 
of stock values are another example iEHi : over long periods of time (typically years) 
one observes a definite trend of increase of, for instance, the value of the dollar. So 
any preset reachable value will necessarily be attained, the questions being: when? and 
what is the time distribution around the average time for the preset value? While the 
classical question is: after such or such period of time, which value can one expect?, 
there might be instances where the reciprocal question should be considered. Because of 
the generality of the propagation-dispersion equation, it should be expected that, either in 
its simple form (fTTT) or in its generalized forms, (l20b and (l27t . the equation be applicable 
to a large class of first-passage type problems in physics and related domains. 
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